The Discipline of Interactive Sonification

نویسندگان

  • Thomas Hermann
  • Andy Hunt
چکیده

This paper argues for a special focus on the use of dynamic human interaction to explore datasets while they are being transformed into sound. We describe why this is a special case of both human computer interaction (HCI) techniques and sonification methods. Humans are adapted for interacting with their physical environment and making continuous use of all their senses. When this exploratory interaction is applied to a dataset (by continuously controlling its transformation into sound) new insights are gained into the data’s macro and micro-structure, which are not obvious in a visual rendering. This paper defines the sub-topic of Interactive Sonification, explains how a certain quality of interaction is required, overviews current sonification techniques, provides examples of the techniques being applied interactively, and outlines a research agenda for this topic.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Interactive Approach for Teaching Information Sonification

Teaching sonification is interdisciplinary and multifaceted. It includes areas such as information graphing, auditory parameters for representation, psychoacoustics affected by the context and combination of parameters, auditory cognition, programming and foundational synthesis or sound production. The interactive pedagogical method presented here fuses these elements in a real-time interactive...

متن کامل

Learning Musical Instrument Skills Through Interactive Sonification

Interactive visualisation methods have been used to understand realtime acoustic analysis for the purpose of learning musical skills. However, interactive sonification has not often been considered, perhaps because it is assumed the musician cannot concentrate simultaneously on two sounds – their instrument’s sound, and the sonified information. However, whilst some finesse is required in desig...

متن کامل

Surface Interactions for Interactive Sonification

This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification mode...

متن کامل

Digiti Sonus: Advanced Interactive Fingerprint Sonification Using Visual Feature Analysis

This paper presents a framework that transforms fingerprint patterns into audio. We describe Digiti Sonus, an interactive installation performing fingerprint sonification and visualization, including novel techniques for representing userintended fingerprint expression as audio parameters. In order to enable personalized sonification and broaden timbre of sound, the installation employs sound s...

متن کامل

Developing a dancer sonification system using the Immersive Interactive Sonification Platform (iISoP)

For decades, researchers have spurred research on sonification, the use of non-speech audio to convey information. As the level of automation increases in the workplace, monitoring the state and performance of complex systems can require more cognitive resources than provided through visual information processing channels. In recent years interactive sonification and gesture-based interaction h...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003